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METHODS, APPARATUS, COMPUTER PROGRAM AND STORAGE 
MEDIUM FOR POSITION DECODING 



Cross-reference to Related applications 

The present application claims the benefit of 

Swedish patent application No. 0301248-1, filed on April 
5 29, 2003, and U.S. Provisional patent application No. 

60/466,036, filed on, April 29, 2003, which both are 

hereby incorporated by reference. 

Field of the Invention 

The present invention generally relates to decoding 
10 of position-coding patterns, and, more specifically, to 
methods for position decoding, in which a sequence of 
positions is extracted from a sequence of images of a 
posit ion- coding pattern, as recorded by a sensor. 

The invention also relates to an apparatus, a 
15 computer program and a storage medium which can be used 
to decode a position-coding pattern. 

Background Art 

Position-coding patterns are known which have the 
20 property that the absolute position in the position- 
coding pattern for a partial area of the position- 
coding pattern of a smallest predetermined size can be 
calculated by means of the information in the partial 
area and a predetermined algorithm. Examples of such 
25 position-coding patterns are disclosed in US 5,477,012 
(O. Sekendur) , where each position is coded by means 
of a symbol, and WO 92/17859 (Hewlett Packard Co.), 
US 6,570,104 (Anoto AB) , US 6,674,427 (Anoto AB) , 
US 6,667,695 (Anoto AB) , US 2003/0012455 (Anoto AB) and 
30 US 5,973,110 (Xerox Corp), where each position is coded 
by means of a plurality of symbols. 
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Position-coding patterns of this type can be used, 
for instance, for digital recording of information which 
is written and/or drawn by hand by means of a user unit 
on a base provided with the position-coding pattern. 
5 While moving the user unit, images of the position-coding 
pattern are continuously recorded locally at the tip of 
the user unit . One or more symbols in each of the images 
are decoded to a position. The decoded positions together 
constitute a digital description of the user unit's move- 

10 ment over the base. 

The posit ion -coding pattern in the recorded images 
can be decoded in different ways. For instance, aforesaid 
US 2003/0012455 discloses a decoding method which 
involves calculating probabilities that symbols which are 

15 identified in a recorded area of the position-coding 

pattern assume any of a plurality of different possible 
decoding values. These probabilities are stored as real 
(floating precision) numbers in probability matrices and 
are used together with the different possible decoding 

20 values for decoding the identified symbols into 

coordinates for positions in the position-coding pattern. 

Aforesaid US 6,674,427 and US 6,667,695 disclose 
other ways of decoding or determining a position from a 
recorded image of a position-coding pattern. 

25 The known position decoding methods may be regarded 

to have the common features that symbol data is extracted 
from an isolated image in a sequence of images to be 
decoded; that position data is derived by effecting one 
or more lookup operations, using the symbol data, in one 

3 0 or more data structures that contain fundamental coding 
data of the position-coding pattern; and/ or that the 
symbol or position data is used as input data to a 
mathematical formula for explicit calculation of an 
absolute position. 

35 Applicant's pending US application No. 10/282,001, 

which -was not yet publicly available at the date of 
filing of the present application, but later published as 



us 2003/0128194, discloses a method for position 
decoding, where a position for a recorded area of the 
posit ion- coding pattern is calculated in a known manner, 
for instance in accordance with aforesaid US 
2003/0012455. However, in case a decoding error is 
detected for said position, either for the position as a 
whole or for one of its coordinates, an additional 
operation is performed as "a last resort"; information 
determined from the recorded area is compared or matched 
with information about how the position-coding pattern is 
composed in a matching area around a successfully decoded 
nearby position. The best matching portion of the known 
matching area is selected, and a corresponding position 
is determined as the decoded position. Thus, in summary, 
US 2003/0128194 discloses mandatory use of decoding by 
calculation of position from recorded area, followed, in 
case of a decoding failure, by an additional matching 
operation. 

Summary of the Invention 

An object of the invention is to provide an alterna- 
tive to known methods of position decoding from recorded 
images of a position-coding pattern. 

More specifically, an object of the invention is to 
allow fast, efficient and yet robust decoding of a 
position-coding pattern. 

Generally, the objects of the invention are at least 
partly achieved by means of methods, an apparatus, a 
computer program and a storage medium according to the 
independent claims, preferred embodiments being defined 
by the dependent claims . 

A first aspect of the invention is a method for 
position decoding, in which a sequence of positions is 
extracted from a sequence of images of a position-coding 
pattern, as recorded by a sensor. The method comprises 
the steps of: retrieving at least one reference position; 
and extracting said secjuence of positions solely by 



matching information obtained from each of said images 
with a corresponding pattern reference area, which 
represents a known siibset of the posit ion- coding pattern 
with a given spatial relation to said reference position. 

That said sequence of positions is extracted solely 
by matching information from each of said images with 
said corresponding pattern reference area means that the 
method is not based on any preceding step in which an 
attempt is made to calculate the positions in another way 
than through aforesaid extracting by matching. 

Each position in said sequence of positions may be 
extracted by: determining a relative location, within 
said pattern reference area, of a match between said 
information and said pattern reference area; and 
adjusting said spatial relation by said relative location 
to thereby derive said position. Thus, the sequence of 
positions may be extracted in a fast and efficient way. 

The pattern reference area, which represents the 
known subset of the position-coding pattern, may be 
generated for each image to be decoded. Alternatively, 
the pattern reference area may be generated only 
intermittently, to thus be used in the decoding of 
several consecutive images in the sequence of images. 

The given spatial relation of the pattern reference 
area to said at least one reference position may be 
either direct, in that the spatial location of each 
pattern reference area is directly defined or calculated 
from the reference position(s), or indirect, in that the 
spatial location is defined or calculated from one or 
more preceding positions, which are preceding in the 
sense that they have been extracted by preceding steps of 
matching. Each such preceding position again has a 
defined spatial location, directly or indirectly, with 
respect to the reference position (s). 

The spatial relation may be given by a predicted 
position which is estimated based on said at least one 
reference position, and by said pattern reference area 
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being generated with a given positional relationship to 
said predicted position. Preferably, the predicted 
position is included in the knovm subset of the position- 
coding pattern as represented by the pattern reference 
5 area. Thereby, the matching may be effected around the 
predicted position. 

The step of estimating the predicted position may be 
effected for each image, to generate a sequence of 
predicted positions, which in turn may be converted, by 

10 said step of extracting by matching, to said sequence of 
positions. The conversion may be effected for a group of 
predicted positions, or sequentially by each predicted 
position being converted by matching to a decoded 
position before estimating a subsequent predicted 

15 position. 

Each predicted position may be estimated based on at 
least two preceding positions selected from said at least 
one reference position and/or said sequence of positions. 
Moreover, each predicted position may be estimated by 

20 polynomial, such as linear, extrapolation of said at 
least two preceding positions. 

The reference position may be retrieved by 
calculating a position based on an image of said 
position-coding pattern in accordance with a prior art 

25 method of position decoding or calculation. Such a 

calculation may typically include: extracting symbol data 
from an isolated image preceding said sequence of images; 
deriving position data by effecting one or more lookup 
operations, using said symbol data, in one or more data 

30 structures that contain fundamental coding data of the 

posit ion- coding pattern; and/or inputting said symbol or 
position data to a mathematical formula for explicit 
calculation of an absolute position. 

The step of retrieving may be effected 

35 intermittently to update or replace said at least one 
reference position, the thus-retrieved reference 
position (s) being used in a subsequent step of extracting 
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by matching for a subsequent sequence of images - The 
retrieval may be effected at a fixed sampling interval, 
or whenever a need for, or opportunity of, such retrieval 
is detected. In digitizing the movement of a writing 
5 implement on a position-coded base, a single handwriting 
stroke may be represented by several consecutive 
sequences of positions, each being extracted by matching. 
The method may suitably comprise the step of merging said 
at least one reference position with said sequence (s) of 
10 positions, so as to form a true representation of the 
movement • 

In one embodiment, the corresponding pattern refe- 
rence area for an individual image among said sequence of 
images includes a plurality of partial areas defining a 

15 plurality of respective candidates to a position repre- 
sented by the position-coding pattern in said individual 
image. In this embodiment, the step of extracting by 
matching may include comparing the information obtained 
from said individual image with each of said plurality of 

20 partial areas included in the corresponding pattern 
reference area. The step of extracting may further 
include selecting the candidate for which the comparing 
step indicates correspondence between the information 
obtained from said individual image and any of said plu- 

25 rality of partial areas. 

The method described above for position decoding can 
advantageously be used together with any of the position- 
coding patterns that have been developed by Anoto AB and 
are described in for instance US 6,674,427 or 

30 US 6,667,695- Thus, the position-coding pattern may 

comprise a plurality of marks, wherein each mark codes 
one of at least two different values in at least one 
dimension . 

In one embodiment, which is adapted for use with a 
35 position-coding pattern of the above type, the step of 
extracting by matching includes obtaining said infor- 
mation from an individual image among said sequence of 
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images by generating a probability matrix, said probabi- 
• lity matrix representing a subarea of the position-coding 
pattern which is included in said individual image and 
containing one matrix element for each mark in said sub- 
5 area, wherein each matrix element is adapted to store 

either a value which represents a most probable estimated 
value of its mark, or a value which represents that no 
value has been estimated for its mark. The value which 
represents a most probable estimated value is preferably 

10 an integer value. Using integer, e.g. binary, values in 

the probability matrix allows fast and efficient matching 
with the pattern reference area, since matrix operations 
performed on integers are faster to perform than for, 
e.g., real numbers . 

15 For a position-coding pattern of the above type, 

where each mark codes a binary value in a first dimension 
and a binary value in a second dimension, a first 
probability matrix may be generated for the values of the 
marks in said first dimension and a second probability 

20 matrix may be generated for the values of the marks in 
said second dimension. 

In one embodiment, said step of extracting by 
matching includes comparing the or each probability 
matrix with each of said plurality of partial areas 

25 included in the corresponding pattern reference area. 

This may be done by bit-wise correlation between the one- 
dimensional contents of the probability matrix and the 
contents, in the same dimension, of each equally sized 
partial area. 

30 Another embodiment is particularly adapted for use 

with a position-coding pattern, each dimension of which 
is based on shifts of a cyclic main number sequence, 
wherein any subsequence, of a first predetermined length 
or longer, of said cyclic main number sequence has an 

35 unambiguously determined position in said cyclic main 
number sequence, and based on a sequence of difference 
numbers representing differences in shifts between pairs 
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of said main number sequence in the position-coding 
pattern, wherein any subsecjuence/ of a second 
predetermined length or longer, of said difference number 
sequence has an unambiguously determined position in said 
5 difference number sequence. This pattern may be of the 
type referred to above. In this embodiment, the step of 
extracting by matching includes: obtaining a first set of 
difference numbers for said pattern reference area; 
obtaining a second set of difference numbers from the or 
10 each probability matrix; matching said second set of 
difference numbers with said first set of difference 
numbers; and extracting a position of said position- 
coding pattern, in said dimension, from a match from said 
matching step. 

15 The second set of difference numbers may be obtained 

by matching respective rows or columns of the or each 
probability matrix with said main number sequence so as 
to estimate main number sequence positions for said rows 
or columns, and deriving the difference numbers of said 

20 second set of difference numbers by subtracting estimated 
main number sequence positions for pairs of rows or 
columns of the or each probability matrix. 

A second aspect of the invention is a method for 
position decoding by determining a position on the basis 

25 of information obtained from a partial area, recorded by 
a sensor, of a position-coding pattern, the position- 
coding pattern comprising a plurality of marks, each mark 
coding one of at least two different values in at least 
one dimension. This method includes the steps of: 

30 generating a probability matrix, said probability matrix 
containing one matrix element for each mark in said 
partial area, each matrix element being adapted to store 
either a value which represents a most probable estimated 
value of its mark, or a value which represents that no 

35 value has been estimated for its mark; matching said 
probability matrix with information about how the 
posit ion -coding pattern is composed in a pattern 
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reference area of said posit ion- coding pattern, said 
pattern reference area being larger than said partial 
area and including said partial area; and selecting, as 
the position to be determined, the one of the positions 
5 defined by said pattern reference area for which the 
matching step indicates correspondence between said 
probability matrix and said matching area. 

The methods described above can be accomplished in 
hardware or software. Thus, a third aspect of the 

10 invention is a computer program, which comprises program 
code that, when executed in a computer, causes the 
computer to carry out a method according to the first or 
second aspect . 

The computer program can be executed by a processor 

15 which is arranged in the same unit as the sensor that 
images the partial area, for which a position is to be 
decoded, or in another unit. 

The computer program can be stored and distributed 
in the form of a storage medium, such as an electronic 

20 memory like RAM, SRAM, DRAM, SDRAM, ROM, PROM, EPROM, 

EEPROM, etc; an optical disk; a magnetic disk or tape; or 
some other commercially available storage medium. The 
storage medium can also be a propagating signal. 

According to a fourth aspect, the invention concerns 

25 an apparatus which comprises a signal-processing unit, 
which is adapted to perform a method according to the 
first or second aspect . 

The signal -processing unit may e.g. be realized 
by a suitably programmed processor, by specifically 

3 0 adapted hardware, such as an ASIC (Application-Specific 
Integrated Circuit) or an FPGA (Field Programmable Gate 
Array) , by digital or analog circuits or any combination 
thereof . 

Other objects, features and advantages of the in- 
35 vention are apparent from the following detailed de- 
scription of the invention, from the appended claims and 
from the drawings. 
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Of course, features of the different embodiments of 
the invention may be combined in one and the same em- 
bodiment - 

Generally, all terms used in the claims are to be 
5 interpreted according to their ordinary meaning in the 
technical field, unless explicitly defined otherwise 
herein. All references to "a/an/the [element, device, 
component, means, step, etc] " are to be interpreted 
openly as referring to at least one instance of said 
10 element, device, component, means, step, etc., unless 
explicitly stated otherwise. The steps of any method 
disclosed herein do not have to be performed in the exact 
order disclosed, unless explicitly stated otherwise. 

Brief Description of the Drawings 
15 The invention will now be described in more detail 

with reference to the accompanying drawings . 

Fig. 1 is a schematic view of a system in which the 
invention can be used. 

Fig. 2 is a schematic illustration of decoding and 
20 matching of partial areas of a position-coding pattern. 

Fig. 3 is a flow chart that illustrates a general 
method according to the invention of determining a 
position by decoding an image of a partial area of a 
posit ion -coding pattern. 
25 Fig. 4 is a schematic illustration of a position- 

coding pattern which may be decoded according to the 
present invention . 

Fig. 5 shows four ideal locations of a mark in a 
posit ion -coding pattern. 
30 Fig. 6 is a schematic illustration of an apparatus, 

in the form of an electronic pen, in which the position 
decoding according to the invention may be carried out. 

Fig. 7 is a schematic block diagram of an electronic 
circuitry part and an image sensor in the device shown in 
35 Fig. 6. 
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Fig. 8 is a schematic illustration that demonstrates 
the way in which a binary offset probability matrix is 
generated. 

Fig. 9 is a flowchart diagram of a first embodiment 
5 of a decoding method according to the invention. 

Fig. 10 shows a generated local position-coding 
pattern and a binary offset probability matrix to illust- 
rate the operating principle of the first embodiment. 

Figs. 11, 12 and 13 are schematic illustrations to 
10 support the description of a second embodiment. 

Fig. 14 illustrates an alternative embodiment, where 
use is made of both the first and the second embodiment. 

Detailed Description of the Invention 

15 Fig. 1 shows a system for information management, in 

which the present invention can be used. The system com- 
prises a base 1 in the form of a sheet of paper, a user 
unit 2 and an external unit 3 . The sheet of paper is 
provided with a posit ion- coding pattern, only a small 

20 part 4 of which is schematically indicated in an enlarged 
scale. The user unit 2 can be used to write on the sheet 
of paper 1 in the same way as with an ordinary pen and to 
simultaneously record what is being written in digital 
form. The digitally recorded information can be processed 

25 in the user unit 2 and/or the external unit 3, to which 
it can be sent automatically (on-line) or when commanded 
by the user. For the digitally recorded information to 
correctly reflect the information on the sheet of paper, 
it is important that the position decoding be made as 

30 correctly and completely as possible. 

The position-coding pattern, which will be described 
in more detail below, is made up of graphical symbols, 
which are arranged or designed according to predetermined 
rules. This means that if a partial area of the position- 

35 coding pattern is correctly imaged, said partial area 

having a predetermined minimum size, the position of the 
partial area in the position-coding pattern can be 
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determined unambiguously by means of one or more symbols 
in the imaged partial area and a predetermined decoding 
algorithm. The position can be obtained as a pair of 
coordinates in a Cartesian or another coordinate system. 
5 When a user writes by means of the user unit 2 on 

the sheet of paper 1, the user unit will continuously 
record images of a partial area of the position-coding 
pattern at the tip of the user unit. Each image is de- 
coded to a position. A sequence of such decoded positions 

10 then constitutes a digital representation of the movement 
of the user unit 2 over the sheet of paper and, thus, of 
what is written on the sheet of paper. 

The decoding of the position-coding pattern can take 
place in the user unit 2, in the external unit 3 or in 

15 some other unit to which the images of the position- 
coding pattern are sent in a more or less processed form. 

As mentioned above, the information in the partial 
area is decoded by means of a predetermined decoding 
algorithm. This functions well as long as the partial 

20 area is correctly imaged. Under actual conditions, how- 
ever, the user unit often cannot image the partial area 
entirely correctly, for instance because of poor lighting 
conditions, or when user holds the pen in an inclined 
position which causes the partial area to be imaged in 

25 perspective, or if the recorded image is deformed by the 
imaging mechanism or by other disturbances such as signal 
noise. It may happen that the decoding algorithm mis- 
interprets a symbol or misses a symbol, thereby making it 
harder to decode the position correctly. Errors can also 

30 arise if the position-coding pattern is not quite accura- 
tely reproduced on the sheet of paper but has been de- 
formed to some extent when being applied to the sheet of 
paper. Under certain conditions, errors can be dis- 
covered, for example, if the position-coding pattern con- 

35 tains redundant information which enables error detection 
or if the decoded position is unreasonable in relation to 
previously or subsequently decoded positions. 
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Figs. 2 and 3 illustrate a general method according 
to the invention of determining a position by decoding an 
image of a partial area of a position-coding pattern. 
This method allows for fast, efficient and reliable 
5 decoding even if it has not been possible to successfully 
record and interpret all symbols within the partial area 
of the position-coding pattern. A sheet of paper 1 is 
provided with a position-coding pattern P, which for the 
sake of clarity is not shown in Fig. 2. A small portion 

10 of the posit ion -coding pattern P is however shown at 20 
in Fig. 4. As will be explained in more detail in the 
following, the position-coding pattern comprises a 
plurality of marks 22 which partly constitute the code 
symbols of the pattern. 

15 As seen in Fig. 2, two partial areas PAl and PAl ' of 

the position- coding pattern P code positions PI and PI", 
respectively. It is assumed in Fig. 2 that positions PI 
and PI' have been successfully decoded from recorded 
images of partial areas PAl and PAl' by way of any 

2 0 applicable decoding method. Next, in step 310 of Fig. 3 
an image of a new partial area PA2 (not explicitly shown 
in Fig. 2) is recorded, for which it is desired to decode 
a corresponding position P2 . The recorded image is pre- 
processed in a step 320 so as to form a suitable input 

25 for a following step 330, in which marks 22 are identi- 
fied and a virtual raster 21 is fit to the marks. Steps 
320 and 33 0 may be performed by way of techniques that 
are well known in the art, such as filtering, binari- 
zation or thresholding, and utilization of the distance 

30 between different pairs of dots or utilization of Fourier 
transforms, as is described for instance in US 6,548,768 
and US 2002/0044138. 

Following steps 320 and 3 30, the actual decoding 
occurs in steps 340 and 350. First, a pair of matrices, 

35 referred to as x-BOPM and y-BOPM in the following, are 
generated by estimating the values represented by the 
marks 22 of the partial area PA2 in x and y dimensions. 
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The information kept by these matrices will then be used 
for matching with information about how the position- 
coding pattern P is composed in a matching area MA. The 
information in the matching area MA may be generated 
5 exclusively for the decoding of only one position by 

matching. As seen in Fig. 2 and as will be described in 
more detail later, the matching area MA is larger than 
the partial area PA2 and has a given positional relation 
to a prediction PA2predicted of the partial area PA2 . The 

10 prediction PA2predicted corresponds to a predicted position 
P2predicted which is determined from the positions PI and 
PI' of the previously decoded partial areas PAl and PAl ' . 
Positions PI and PI » are thus examples of the "at least 
one reference position" referred to in the Summary 

15 section of this document, and the matching area MA is an 
example of the "pattern reference area" . 

The size of the matching area MA may be set to a 
constant value which reflects a normal or default 
handwriting speed. For instance, the matching area MA may 

20 contain 32x32 code symbols. Alternatively, the size of 
the matching area MA may be adjusted dynamically 
depending on appropriate input data, such as current 
handwriting speed. The size of the partial area PA2 may 
be chosen in view of the size of the matching area MA and 

25 also depending on the size of the recorded images. The 
partial area PA2 need not occupy the entire part of an 
recorded image. The partial area need not even have the 
above -discussed minimum size for unambiguous position 
determination. Generally speaking, the robustness of the 

3 0 decoding process increases with increasing size of the 

partial area, whereas the speed and the efficiency of the 
decoding process increase with decreasing size of the 
partial area. At present, a size of 16x16 code symbols is 
used for the partial area PA2 . 

35 The result of steps 340 and 350 may be the partial 

area PA2matched that best matches an equally sized subarea 
of the matching area MA, and the relative location of 



PA2nTatched with respect to the matching area MA and, thus, 
with respect to the predicted position P2predicted. Hence, a 
position P2matched defined by the resulting partial area 
PA2matched Hiay be determined by simply adding this relative 
location to the predicted position P2predicted- As seen in 
Fig. 2, while in practice the predicted partial area 
PA2predicted will not exactly correspond to the recorded 
partial area PA2 , the matched partial area PA2matched will. 
Thus, the result of the decoding method will be the 
position P2matched which is identical to the position P2 
sought for. The determined position may be verified in a 
step 360. 

A brief description of an apparatus - in the form 
of an electronic pen - in which the position decoding 
according to the invention may be carried out will now be 
given with reference to Figs . 6 and 7 . 

The apparatus of Figs. 6 and 7 can constitute the 
user unit 2 in Fig. 1. It comprises a casing 2011 having 
approximately the same shape as a pen. In one short side 
of the casing there is an opening 2012. The short side is 
intended to abut against or be placed a short distance 
from the surface on which the position determination is 
to take place. 

The casing essentially contains an optics part, an 
electronic circuitry part, and a power supply. 

The optics part comprises a light -emitting diode 
2013 for illuminating the surface which is to be imaged 
and a light-sensitive area sensor 2014, such as a CCD 
(Charge Coupled Device) or CMOS (Complementary Metal - 
Oxide Semiconductor) sensor, for recording a two- 
dimensional image. The apparatus may also comprise an 
optical system, such as a mirror and/or lens system. The 
light -emit ting diode can be an infrared light -emit ting 
diode and the sensor can be sensitive to infrared light. 

Generally speaking, the image sensor 2 014 may be 
replaced by any kind of sensor that is suitable for 
imaging the position-coding pattern so that an image of 
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the marks is obtained in black and white, in grey scale 
or in color. Such a sensor can be a solid-state single- 
or mult i -chip device which is sensitive to electro- 
magnetic radiation in any suitable wavelength range. For 
5 example, the sensor may include a CCD element, a CMOS 
element, or a CID element (Charge Injection Device) . 
Alternatively, the sensor may include a magnetic sensor 
array for detection of a magnetic property of the marks. 
Still further, the sensor may be designed to form an 

10 image of any chemical, acoustic, capacitive or inductive 
property of the marks. 

The power supply to the apparatus is obtained from a 
battery 2015 which is mounted in a separate compartment 
in the casing. The power supply can also be obtained via 

15 a cable from an external power source (not shown) . 

The electronic circuitry part 2016 comprises a 
processor unit with a processor which may be programmed 
to read images from the sensor and carry out position 
calculation, matching and verification on the basis of 

20 these images, as well as a working memory and a program 
memory . 

Furthermore, in the shown embodiment, the apparatus 
comprises a pen point 2017, by way of which it is 
possible to write ordinary pigment -based ink on the 

25 surface upon which the position determination is to be 
carried out. The pen point 2017 can be extendable and 
retractable, so that the user can control whether or not 
it is to be used. In certain applications, the apparatus 
need not have a pen point at all. 

30 Suitably, the pigment-based ink is of a type that is 

transparent to infrared light, while the marks absorb 
infrared light. By using a light -emit ting diode which 
emits infrared light and a sensor which is sensitive to 
infrared light, the detection of the pattern takes place 

35 without any interference between the above-mentioned 
writing and the position-coding pattern. 
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Moreover, the apparatus may comprise buttons 2018 
by means of which the user will activate and control the 
apparatus. It also comprises a transceiver 2019 for wired 
or wireless transmission, e.g. using cable, IR light, 
5 radio waves or ultrasound, of information to and from the 
apparatus. The apparatus can also comprise a display 2020 
for showing positions, recorded information or other 
information to the user. 

The apparatus can be divided into different physical 

10 casings. The sensor and other components that are neces- 
sary for capturing images of the position-coding pattern 
and for transmitting them may be located in a first 
casing, while the signal-processing unit and the other 
components that are necessary for carrying out the 

15 position decoding may be located in a second casing. 

Fig. 7 is a schematic block diagram of the electro- 
nic circuitry part 2016 and the image sensor 2014 in the 
apparatus shown in Fig. 6. An ASIC 700 implements the 
electronic circuitry part 2016 and contains a CPU 720 as 

20 a main controller of the electronic circuitry. The CPU 
720 has access to a memory 730 through an on-chip data 
bus 760. The image sensor 2014 is implemented as a CMOS 
area sensor 750, which is connected to the data bus 760 
of ASIC 700 and which is capable of producing 96x96- 

25 pixel, 256-level grayscale digital images at a frequency 
of about 100 Hz. An image preprocessor 710 on ASIC 700 
will operate on images received from the image sensor 750 
in accordance with step 320 of Fig. 3 and store the 
preprocessed images in memory 730. The CPU 720 will 

30 generate the x-BOPM and y-BOPM matrices and will also 

perform the decoding of partial areas into positions. A 
matching unit 740 may assist the CPU 720 in these tasks. 
In an alternative embodiment, the ASIC 700 may be 
designed to operate without intermediate storage of the 

35 preprocessed images. 

In the following, the position decoding will be 
exemplified and described in more detail with reference 
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to a specific position- coding pattern which has been 
developed by the applicant ,and which is thoroughly- 
described in, inter alia, US 6,667,695. Position-coding 
patterns of similar types are described in detail in WO 
5 01/16691, US 6,663,008 and US 6,674,427. An alternative 
posit ion -coding pattern is shown in US 6,570,104. 

The position coding is based on a number sequence 
which below is referred to as difference number sequence. 
This difference number sequence has the property that if 

10 one takes an arbitrary partial sequence of a predetermin- 
ed length, for instance a partial sequence with five dif- 
ference numbers, this partial sequence always .has an 
unambiguously determined location in the difference num- 
ber sequence. In other words, it appears only once in the 

15 difference number sequence and can thus be used for posi- 
tion determination. More specifically, the difference 
number sequence "runs" along the x axis as well as along 
the y axis of the position-coding pattern. 

The actual position-coding pattern is made up of 

20 simple graphical symbols 22 which can assume four diffe- 
rent values, 0-3. As seen in Figs. 4 and 5, each symbol 
22 contains a mark which, for instance, can have the 
shape of a dot and which can be displaced a distance 24 
in one of four different directions relative to a nominal 

25 position 23 or raster point. The nominal position 23 is 

at an intersection between raster lines 21 in a grid that 
may be virtual, i.e. invisible to the area sensor in the 
pen, or actual, by the raster lines being wholly or 
partly visible to the area sensor. The value of the 

30 symbol is determined by the direction of the dis- 
placement. Each symbol value 0-3 can be converted into 
one bit which is used for coding an x coordinate and one 
bit which is used for coding a y coordinate, i.e. into 
the pairs of bits (0,0), (0,1), (1/0), and (1,1). Thus, 

35 the coding is made separately in the x direction and the 
y direction, but the graphical coding is made with a 
symbol which is common to the x and y bits. 



19 

The distance 24 is suitably not less than about 1/8 
and not more than about 1/4, preferably about 1/6, of the 
distance between two adjacent raster lines 21. The 
distance can, for example, be about 300 micrometers or 
5 about 254 micrometers. The latter distance is particu- 
larly suitable for printers and scanners, which often 
have a resolution that is a multiple of 100 dpi (dots per 
inch) . 

Each position is coded by 6*6 symbols which can 

10 thus be converted into a 6 * 6 bit matrix for an x coor- 
dinate and a 6 * 6 bit matrix for a y coordinate for the 
position. If the x bit matrix is considered, this can be 
divided into six columns of six bits each. Each sequence 
of bits in a column constitutes a partial secjuence in a 

15 63 -bit -long cyclic main number sequence which has the 
property that if a partial sequence having a length of 
six bits is selected, this has an unambiguously deter- 
mined place in the main number sequence. The six columns 
can thus be converted into six position numbers or 

20 sequence values which correspond to six places in the 

main number sequence. Between these six position numbers, 
five difference numbers can be formed in pairs, which 
constitute a partial sequence of the difference number 
sequence and which thus have an unambiguously determined 

25 place in the same and, consequently, an unambiguously 
determined place along the x axis. For a certain x co- 
ordinate, the position numbers will vary depending on the 
y coordinate. On the other hand, the difference numbers 
will be the same independently of the y coordinate, since 

30 the position numbers always vary according to the main 
number sequence, which is repeated cyclically in the 
columns in the entire position-coding pattern. 

Correspondingly, six rows in the y bit matrix define 
six position numbers in the main number sequence. These 

35 six position numbers define five difference numbers, 
which constitute a partial sequence of the difference 
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number sequence and which thus have an unambiguously 
determined place along the y axis . 

When the position-coding pattern is used, images 
of different parts of the position- coding pattern are 
5 recorded, as has been described above. As a rule, the 
images contain considerably more than 6*6 symbols. 
Thus, the decoding may be based on the best n * m symbols 
in the image, with n and m being any number of symbols 
equal to 6 or larger. For example, the decoding may be 
10 based on the best 8 * 8 or 16 * 16 symbols. The extra 

symbols are used, inter alia, for error detection and/or 
correction. 

In the following, position decoding based on the 
above -described position-coding pattern will be described 

15 with reference to the drawings. The position decoding is 
preferably carried out by means of a processor and suit- 
able program code which can be available in the user unit 
2 or the external unit 3 in Fig. 1 or in some other unit. 
Since the position-coding pattern is not always per- 

20 fectly reproduced on a surface and since the user unit 
sometimes deforms the posit ion- coding pattern during 
imaging, it may be difficult to determine quite safely 
the displacements of the dots and, thus, the value of the 
symbols. Instead, for each symbol the probability that 

25 the symbol assumes any of the four different possible 

values may be determined. According to embodiments of the 
present invention, aforesaid two matrices are generated 
in step 340 of Fig. 3 for an imaged partial area PA - one 
for columns (x coordinate encoding) and one for rows (y 

3 0 coordinate encoding) . Each matrix element in each of 
these two matrices may contain an integer value that 
represents the estimated binary value of the symbol in 
the X direction and y direction, respectively. This is in 
contrast to the prior art, e.g. aforesaid 

35 US 2003/0012455, where each matrix element contained two 
real numbers (floating-precision numbers) representing 
the probability of the symbol value "0" and "1", , 
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respectively. These two matrices may be referred to as 
Binary Offset Probability Matrices (BOPM) and are 
identified as "x-BOPM" and "y-BOPM" in the drawings. 

In addition, each matrix element in the x-BOPM and 
5 y-BOPM matrices may indicate that no binary value was 
estimated for the symbol, e.g. because it was not 
possible, at some level of certainty, to decide which of 
the four possible displaced positions (Fig. 5) that the 
mark 22 in question assumes. 

10 Thus, each matrix element in the x-BOPM and y-BOPM 

matrices will contain any of the values "0", "1" or "-», 
the latter representing that no binary value was esti- 
mated for the symbol . 

Various methods may be employed when analyzing a 

15 recorded and preprocessed image so as to estimate, if 

possible, the binary values of the symbol in the x and y 
directions - as given by the displacement of the mark 22 
- and otherwise represent the symbol by the uncertainty 
value " - " . 

20 For instance, for each identified mark it may be 

investigated whether it lies within a certain "safe" zone 
around any of the four ideal displacement positions shown 
in Fig. 5. Such "safe" zones may e.g. be defined by 
circular areas having their centers at respective ones of 

25 the four ideal displacement positions and having a 

predefined radius. Thus, if a mark is found to lie within 
any such "safe" zone, the symbol is held to have the 
value represented by the ideal displacement position that 
forms the center of the "safe" zone. 

30 Alternatively, "full-scale", real-number probability 

matrices may be calculated based on a distance function 
that outputs a real -number probability value based on the 
displacement of a mark from an ideal displacement 
position. Examples of such calculations are given in 

35 aforesaid US 2003/0012455. Then, probability threshold 
values may be applied to the real -number probability 
matrices, such that if for instance such a probability 
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matrix indicates that a certain mark encodes a "0" or a 
"1" at a probability in excess of 0.8, where 0.8 is the 
threshold, then the corresponding matrix element in the 
x-BOPM or y-BOPM matrix will be set to "0" or "1"; 
5 otherwise the matrix element will be set to "-»«. 

As still an alternative, if the encoding of the 
marks is such that the same x value (y value) is used for 
the two ideal positions that lie above a diagonal line 
through the raster point 23 (e.g. positions b and c in 

10 Fig. 5) as well as for the other two that lie below such 
a diagonal line (e.g. positions a and d in Fig. 5), the 
location of an identified mark and its distance to such a 
diagonal line may be used to estimate the binary values 
of the symbol in question. 

15 The x-BOPM and y-BOPM matrices thus produced are 

used in step 350 of Fig. 3 in two different ways, 
according to the disclosed embodiments, so as to decode 
the position coded by the pattern in the partial area PA 
of the recorded image . 

20 In a first embodiment, which will be described with 

reference to Figs. 8-10, a method referred to as Pattern 
Neighborhood Matching (PNM) is used for matching a re- 
corded partial area PA (as represented by the x-BOPM and 
y-BOPM matrices) with a larger matching area MA of the 

25 posit ion- coding pattern, generated around a predicted 
position in the position-coding pattern. The predicted 
position is produced from preceding positions defined by 
preceding partial areas of the position-coding pattern. 
Here, a complete bit -wise correlation between the 

30 recorded partial area PA and the generated matching area 
MA is performed. Thus, this method will be capable of 
successful decoding also if the recorded partial area PA 
contains several uncertain or incorrectly estimated 
symbols. 

35 A second embodiment, which will be described with 

reference to Fig. 11-13, concerns a method referred to as 
Pattern Sequence Matching (PSM) . Here, no full bitwise 
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correlation between recorded partial area PA and matching 
area MA is performed. Instead, matching is made between 
difference subsequences found in the recorded partial 
area PA and difference subsequences for a larger matching 
5 area MA, which again is generated around a predicted 

position in the position-coding pattern. This method will 
be faster, since the number of matches performed is 
smaller than for the PNM method (ideally, the running 
time will be proportional to the sum of the side lengths 

10 of the matching area as compared to the product of the 
side lengths) . It is, however, less capable of decoding 
partial areas with many uncertain or incorrectly 
estimated symbols. 

Pattern Neighborhood Matching 

15 As explained above, the position-coding pattern is a 

composition of an x encoding and a y encoding. Thus, the 
decoding may be handled separately for the two dimen- 
sions. Fig. 8 schematically shows a recorded partial area 
800, consisting of 10x10 raster intersections and dots 

20 positioned at different displacements from the respective 
intersections. For each column (and each row) some of the 
encoded x (and y, respectively) values may be determined 
by identifying that a dot is located sufficiently close 
to one of the four possible ideal displacements - 

25 "right", "upwards", "left" or "downwards" by e.g. 1/6 of 
the raster cell size. For instance, dot 840 may be 
determined to represent displacement "left", thereby 
yielding (x, y) = (1, 0) according to coding legend 830. 
On the other hand, at some raster intersections it will 

30 not be possible to decide what a nearby dot, if any, 

encodes. For instance, dot 850 is located too close to 
its raster intersection, and at intersection 860, no dot 
is present at all. In these cases, neither x nor y value 
can be estimated. Thus, there is a need to express un- 

35 certainty about the value at a certain raster inter- 
section, in X and/or y dimension. 
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By traversing the columns and rows of the recorded 
partial area in the above -described manner and in 
accordance with step 340 in Fig. 3, three characters or 
values " 0 " , "1 " and " - " may be used to represent the 
5 interpretation of column encodings (e.g. 820 in Fig. 8) 
and row encodings (e.g. 810 in Fig. 8), wherein the 
indicates uncertainty about the dot displacement. 

As already mentioned, this process results in two 
matrices, one for columns (x-coordinate encoding) and one 

10 for rows (y-coordinate encoding) , namely the binary 

offset probability matrices x-BOPM and y-BOPM. An y-BOPM 
example is given at 1010 in FIG 10. In a sense, the x- 
BOPM and y-BOPM are trinary rather than binary, since in 
addition to binary values they also have one value that 

15 represents uncertainty. 

The x-BOPM and y-BOPM may be stored in memory 730. 
In more detail, each row of a matrix may be stored in a 
first n-bit data register (n being the size of the matrix 
in one dimension) that represents the "certain" values 

20 "0" and "1", and in a second n-bit data register that 
represents bit flags as to whether or not uncertainty 
applies to the corresponding value in the first n-bit 
data register. If a bit flag is set in the second data 
register, this will mean that the corresponding bit value 

25 is not to be used and that the matrix cell in question 
has a " - " value . 

Fig. 9 illustrates the pattern neighborhood matching 
method 900, which implements the decoding and verifying 
steps 350 and 360 for this embodiment. Input data for 

30 this method is the above-mentioned two binary offset 

probability matrices x-BOPM and y-BOPM, as generated in 
step 340 of Fig. 3, as well as the two preceding posi- 
tions PI and PI* of Fig. 2. 

In step 910, based on the two preceding positions PI 

35 and PI » , a next position P2predicted is derived by linear 
extrapolation from positions PI and PI'. As an alterna- 
tive, more than two preceding positions may be used for 
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predicting the next position, wherein any knovm motion 
prediction model may be used, such as polynomial extra- 
polation. As yet an alternative, only one preceding 
position may be used, if the prediction is combined with 
5 motional data input concerning e.g. direction of move- 
ment, speed or acceleration of the user unit 2, or other 
useful information, such as default or predefined in- 
formation on expected handwriting speed. Only one 
preceding position may also be used if the size of the 

10 matching area MA is set adequately large to include a 
following position. Such a matching area is suitably 
centered around the preceding position. The above 
alternatives may also be combined, e.g. by different 
numbers of preceding positions being used at different 

15 stages of the decoding process . 

The or each preceding position PI, PI' may be 
determined in different ways. For instance, at the very 
beginning of a pen stroke, PI, PI' may be calculated in 
accordance with any prior art method, including but not 

20 limited to the ones described in aforesaid US 6,667,695, 
US 2003/0012455 and US 6,674,427, all incorporated 
herewith by reference. Then, as new positions have been 
decoded by matching in accordance with the invention, 
they may be used as preceding positions PI, PI' to form 

25 the basis of the prediction of a new position P2 . 

In step 920, the matching area MA {Fig. 2) of the 
position-coding pattern is generated around the predicted 
position. An example of a generated matching area is 
given at 1000 in Fig. 10. For instance, aforesaid 

30 US 6,667,695, in column 11, line 57 - column 15, line 14, 
and in Fig. 6 thereof, describes in detail how an area of 
the posit ion- coding pattern may be generated from a given 
position. 

In step 930, one of the binary offset probability 
35 matrices, e.g. y-BOPM, is matched with the contents of 
the generated matching area in the corresponding 
dimension, e.g. y dimension. To this end, matching unit 
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740 will perform bitwise correlation between the y-BOPM 
and each equally sized partial area of the matching area. 
For each such bitwise correlation, the matching unit 740 
will count the number of corresponding bits in the y-BOPM 
5 and the partial area. If a bit is set to the uncertainty 
value in the y-BOPM, this position will simply be 

dispensed with and no bit correspondence will of course 
be credited this position. 

Once the y-BOPM has been matched with the entire 
10 matching area, the CPU 720 will determine the one of the 
partial areas for which the best match occurred with the 
y-BOPM (cf PA2matched in Fig. 2) . In Fig. 10, the best 
matching partial area of the matching area 1000 is indi- 
cated at 1020 . 

15 In step 940, a resulting position (cf P2n,atched in 

Fig. 2) is calculated from the best matching partial 
area. This position is easily determined, since the 
absolute start position of the matching area MA in the 
position- coding pattern is already known (given by the 

20 predicted position P2predicted) ■ Thus, the resulting posi- 
tion is added as a relative position to the known abso- 
lute start position of the matching area MA so as to 
yield absolute- value coordinates of the predicted posi- 
tion. 

25 It is to be observed that this embodiment results in 

a fully decoded position (both x and y coordinates) from 
the row pattern on y-BOPM matching. Nevertheless, by also 
performing x-BOPM matching with the matching area in . 
steps 950 and 960, the result of steps 93 0 and 940 may be 

30 verified to gain robustness: if and only if the best 
correlations agree on both coordinates, the result is 
accepted in step 970. Thus, steps 950 and 960 may imple- 
ment the verifying step 360 of Fig. 3. 

As an alternative to such a separate verifying 

35 operation in steps 950 and 960, two match matrices, one 
for the y-BOPM matching and one for the x-BOPM matching, 
may be generated in parallel in steps 930 and 940. A 
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matrix element in each of these match matrices will 
represent the number of matching x/y bit values for the 
partial area PA that starts with that matrix element's 
position in the matching area MA. By adding these two 
5 match matrices element by element, the CPU 72 0 may select 
the particular element position having the highest 
resulting sum as the matched position P2matched sought for. 
Thus, in this case a verification is inherent in the 
matching operation. 

10 Alternatively or additionally to the above 

verification methods, the partial area(s) with the best 
correlation with the x-BPOM and/or the y-BOPM may only be 
used for position determination if a matching criterion 
is met. The matching criterion may include that the 

15 number of matches (i.e. bit correspondences) exceeds a 
predetermined threshold value and/or that the ratio of 
the number of matches to the number of possible matches 
exceeds a predetermined threshold value . The number of 
possible matches may be given by the number of "certain" 

20 values (i.e. not set to the uncertainty value "-") in the 
x-BOPM and y-BOPM, respectively. 
Pattern Sequence Matching 

This method makes use of the fact that positions are 
coded in the position-coding pattern based on two one- 

25 dimensional difference number sequences. Thus, the 

matching may be handled as two one-dimensional problems 
rather than one two-dimensional. This will mean the 
searching time required for matching is linear {ordo 
(n+m) ) instead of quadratic (ordo (n*m) ) , n and m being 

3 0 the side lengths of the matching area. 

With reference to Fig. 13, the pattern sequence 
matching (PSM) method 1300 starts with a step 1310 of 
predicting the next position P2predicted. Step 1310 may be 
performed in the same way as has been described above for 

35 step 910 of Fig. 9. 

In a step 1320, matching difference number sub- 
sequences MSx and MSy (see 122 0 in Fig. 12) are generated 
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for a matching area MA (see 1200 in Fig. 12) around the 
predicted position P2predicted. The actual matching area 
itself is not generated, though, in contrast to the first 
embodiment. Aforesaid US 6,667,695 describes, in column 
5 11, line 57 - column 15, line 14, and in Fig, 6 thereof, 
how a difference number subsequence can be calculated 
from a given position. 

A step 1330 derives sets of difference numbers Sx 
and Sy for the recorded partial area PA2 , to be matched 

10 with the predicted matching difference number 

subsequences MSx and MSy produced in step 1320. First, 
with reference to Fig. 11, for each row/column .1110 in 
the y-BOPM/x-BOPM the best matching main number sub- 
sequence 112 0 in the main number sequence 1100 is deter- 

15 mined- This may be done by a fast matching algorithm, 
based on the fact that if six consecutive accurate bit 
values (i.e. having estimated values "0" or "1" but not 
"-") are found in the BOPM, this combination of six 
values will inherently have a unique position in the main 

20 number sequence. This unique main number sequence 

position may be obtained directly from a lookup table 
which is conveniently stored in memory 73 0 and consists 
of the 63 different cyclic shifts of the main number 
sequence 1100. The other accurate positions in the 

25 particular row/column 1110 of the y-BOPM/x-BOPM are then 
checked against the particular main number sequence shift 
from the lookup table, and if also these are found to 
match, then the derived main number sequence position is 
held to be correct. If not, a full bit -wise matching is 

30 done between the particular row/column 1110 of the y- 

BOPM/x-BOPM and all 63 main number sequence shifts in the 
lookup table, wherein the best match is selected as the 
derived main number sequence position for that row/column 
1110. Simultaneously, a main number sequence match rate 

35 is registered in the form of the total number of matching 
bit values for the particular row/column 1110 of the y- 
BOPM/x-BOPM. 
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Then, step 1330 continues by deriving sets of 
difference numbers Sx and Sy (123 0 in Fig. 12) by sub- 
tracting derived main number sequence positions for ad- 
jacent rows/columns. Also, each difference number is 
5 assigned a difference number match rate, for example by 
weighting (e.g. summing or averaging) the main number 
sequence match rates of the related rows/columns, or by 
selecting the minimum thereof. 

Now, in step 1340 the thus derived (i.e. observed) 

10 sets of difference numbers Sx and Sy are matched with the 
predicted difference number subsequences MSx and MSy, as 
indicated at 1220 in Fig. 12. The best match in the 
subsequences MSx and MSy may be selected as the 
respective consecutive combination of difference numbers 

15 that yields the highest number of matches, optionally 
further distinguished by selecting the combination 
thereof having the highest sum of difference number match 
rates. Alternatively, the best match may be selected as 
the combination of matching difference numbers that 

20 yields the highest sum of difference number match rates, 
irrespective of the number of matches. 

In step 1350 the resulting position P2matched is 
determined from the resulting best match in step 1340. 
For reasons that are similar to the ones given in the 

25 description above for step 940 of Fig. 9, this resulting 
position is easily calculated. 

In step 1360, the resulting position P2matched is 
verified, for instance by generating a local verifying 
area of the position-coding pattern around position 

30 P2matched and correlating this bit-wise with the x-BOPM and 
y-BOPM. This verification may include a matching 
criterion. As with the above -described Pattern 
Neighborhood Matching, the matching criterion may include 
that the number of matches (i.e. bit correspondences) 

35 should exceed a predetermined threshold value and/or that 
the ratio of the number of matches to the number of 
possible matches should exceed a predetermined threshold 
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value. Instead of generating a complete local verifying 
area around position P2matched/ use may be made of the 
calculations performed in step 1330. Since the selected 
resulting position P2matched is the one with the best 
5 match, many of the derived difference numbers are likely 
to correspond with the predicted ones. The numbers of 
matches for the best matching main number sequences 
underlying these corresponding difference numbers are 
already known, via the above-mentioned main number 
10 sequence match rate. Thus, a local verifying area need 
only be generated for difference numbers which do not 
match. 

Combination of Pattern Sequence Matching and Pattern 
Neighborhood Matching 

15 The two embodiments may be combined, for instance as 

will be described with reference to Fig. 14. 

As seen at 1400, matching is performed based on the 
generated x-BOPM and y-BOPM and the matching area 
information obtained through the predicted position. 

20 First, pattern sequence matching 1402 is performed. If 

the decoding is successful, verification is performed at 
1410. If, on the other hand, the pattern sequence 
matching 1402 fails, then pattern neighborhood matching 
1404 is performed. If this succeeds, verification follows 

25 at 1410. However, if also the pattern neighborhood 

matching 1404 fails, an attempt to solve the position by 
other, known methods is made at 1420. Such methods may 
involve any of the ones described in aforesaid 
US 6,667,695, US 2003/0012455 and US 6,674,427. There are 

30 situations where one could expect such methods to succeed 
even if the matching methods according to the invention 
have failed. One example is if the size of the matching 
area MA is too small to "catch up with" a fast-writing 
user. Another example is when the pen is moved over a 

35 position discontinuity in the position-coding pattern, 
for instance when a pen stroke is drawn from one 
posit ion -coded base to another. If the position is 
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successfully solved at 1420, the result is verified at 
1410. 

If verification of a result from matching 1400 
fails, a further attempt may be made to solve the 
5 position at 1420. If also this attempt fails, another 
existing position-solving method may be tried at 1420, 
until all available ones have been tried. 

The invention has mainly been described above with 
reference to a few embodiments. However, as is readily 
10 appreciated by a person skilled in the art, other embodi- 
ments than the ones disclosed above are equally possible 
within the scope of the invention, as defined by the 
appended patent claims. 
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CLAIMS 



1. A method for position decoding, in which a 
sec[uence of positions is extracted from a sequence of 

5 images of a position-coding pattern, as recorded by a 
sensor, characterized by the steps of: 

retrieving at least one reference position; and 
extracting said sequence of positions solely by 
matching information obtained from each of said images 
10 with a corresponding pattern reference area, which 

represents a known subset of the position-coding pattern 
with a given spatial relation to said reference position. 

2. A method as in claim 1, wherein each position in 
said sequence of positions is extracted by: determining a 

15 relative location, within said pattern reference area, of 
a match between said information and said pattern 
reference area; and adjusting said spatial relation by 
said relative location to thereby derive said position. 

3. A method as in claim 1 or 2 , further comprising 
20 the step of generating said pattern reference area for 

each image . 

4. A method as in any preceding claim, wherein said 
spatial relation is given by a predicted position, the 
method comprising the step of estimating said predicted 

25 position based on said at least one reference position. 

5. A method as in claim 4, wherein said pattern 
reference area is generated with a given positional 
relationship to said predicted position. 

6. A method as in claim 5, wherein said predicted 

30 position is included in the known subset of the position- 
coding pattern. 

7. A method as in any one of claims 4-6, wherein 
said step of estimating is effected for each image, to 
generate a sequence of predicted positions. 

35 8. A method as in claim 7, wherein said sequence of 

predicted positions are converted, by said step of 
extracting by matching, to said sequence of positions. 
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9. A method as in any one of claims 4-8, wherein 
each predicted position is estimated based on at least 
two preceding positions selected from said at least one 
reference position and/or said sequence of positions. 
5 10. A method as in claim 9, in which said predicted 

position is estimated by polynomial extrapolation of said 
at least two preceding positions. 

11. A method as in any preceding claim, in which 
each reference position is retrieved by calculating a 

10 position based on an image of said posit ion- coding 

pattern in another way than said step of extracting by 
matching. 

12. A method as in claim 11, wherein said step of 
calculating a position includes: extracting symbol data 

15 from an isolated image preceding said sequence of images; 
deriving position data by effecting one or more lookup 
operations, using said symbol data, in one or more data 
structures that contain fundamental coding data of the 
position-coding pattern; and/or inputting said symbol or 

20 position data to a mathematical formula for explicit 
calculation of an absolute position. 

13 . A method as in any preceding claim, further 
comprising the step of merging said at least one 
reference position with said sequence of positions. 

25 14 . A method as in any preceding claim, wherein said 

step of retrieving is effected intermittently to update 
or replace said at least one reference position, the 
thus -retrieved reference position being used in a 
subsequent step of extracting by matching for a 

30 subsequent sequence of images. 

15. A method as in any preceding claim, wherein, for 
an individual image among said sequence of images, the 
corresponding pattern reference area includes a plurality 
of partial areas defining a plurality of respective 

35 candidates to a position represented by the position- 
coding pattern in said individual image. 
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16. A method as in claim 15, wherein said step of 
extracting by matching includes comparing the information 
obtained from said individual image with each of said 
plurality of partial areas included in the corresponding 

5 pattern reference area. 

17. A method as in claim 16, wherein said step of 
extracting by matching includes selecting, for an indivi- 
dual image among said sequence of images, the one of said 
plurality of respective candidates for which the com- 

10 paring step indicates correspondence between the 

information obtained from said individual image and any 
of said plurality of partial areas. 

18. A method as in any preceding claim, wherein the 
posit ion -coding pattern comprises a plurality of marks 

15 and wherein each mark codes one of at least two different 
values in at least one dimension. 

19. A method as in claim 18, in which said step of 
extracting by matching includes obtaining said infor- 
mation from an individual image among said sequence of 

20 images by generating a probability matrix, said probabi- 
lity matrix representing a subarea of the posit ion- coding 
pattern which is included in said individual image and 
containing one matrix element for each mark in said 
subarea, wherein each matrix element is adapted to store 

25 either a value which represents a most probable estimated 
value of its mark, or a value which represents that no 
value has been estimated for its mark. 

20. A method as in claim 19, wherein said value 
which represents a most probable estimated value is an 

3 0 integer value. 

21. A method as in claim 19 or 20, wherein each mark 
codes a binary value in a first dimension and a binary 
value in a second dimension, and wherein a first probabi- 
lity matrix is generated for the values of the marks in 

35 said first dimension and a second probability matrix is 
generated for the values of the marks in said second 
dimension. 
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22. A method as in any one of claims 19-21 and any- 
one of claims 16-17, wherein said step of extracting by 
matching includes comparing the or each probability 
matrix with each of said plurality of partial areas 

5 included in the corresponding pattern reference area. 

23. A method as in any one of claims 19-21, each 
dimension of the position- coding pattern being based on 
shifts of a cyclic main number sequence, wherein any 
subsequence, of a first predetermined length or longer, 

10 of said cyclic main number sequence has an unambiguously 
determined position in said cyclic main number sequence, 
and based on a sequence of difference numbers 
representing differences in shifts between pairs of said 
main number sequence in the position-coding pattern, 

15 wherein any subsecjuence, of a second predetermined length 
or longer, of said sequence of difference numbers has an 
unambiguously determined position in said sequence of 
difference numbers, said step of extracting by matching 
including : 

20 obtaining a first set of difference numbers for said 

pattern reference area; 

obtaining a second set of difference numbers from 
the or each probability matrix; 

matching said second set of difference numbers with 
25 said first set of difference numbers; and 

extracting a position of said position-coding 
pattern, in said dimension, from a match from said 
matching step. 

24. A method as in claim 23, wherein said step of 
30 obtaining a second set of difference numbers includes: 

matching respective rows or columns of the or each 
probability matrix with said main number sequence so as 
to estimate main number secjuence positions for said rows 
or columns ; and 
35 deriving the difference numbers of said second set 

by subtracting estimated main number sequence positions 
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for pairs of rows or columns of the or each probability 
matrix. 

25. A method as in any preceding claim, wherein said 
sequence of positions represents at least a part of a 

5 handwriting stroke performed by way of an electronic 
handwriting tool. 

26. A method as in any one of claims 4-10, said 
sequence of images being recorded by way of an electronic 
handwriting tool, wherein said predicted position is 

10 estimated based on said at least one reference position 
and at least one of the following: a predefined or 
detected direction of movement, speed or acceleration of 
said handwriting tool. 

27. A method for position decoding by determining a 
15 position on the basis of information obtained from a 

partial area, recorded by a sensor, of a position-coding 
pattern, the position-coding pattern comprising a plura- 
lity of marks, each mark coding one of at least two 
different values in at least one dimension, 

20 characterized by the steps of : 

generating a probability matrix, said probability 
matrix containing one matrix element for each mark in 
said partial area, each matrix element being adapted to 
store either a value which represents a most probable 

25 estimated value of its mark, or a value which represents 
that no value has been estimated for its mark; 

matching said probability matrix with information 
about how the position-coding pattern is composed in a 
pattern reference area of said position-coding pattern, 

30 said pattern reference area being larger than said 
partial area and including said partial area; and 

selecting, as the position to be determined, the one 
of the positions defined by said pattern reference area 
for which the matching step indicates correspondence 

35 between said probability matrix and said pattern 
reference area. 



28. A method as in claim 27, wherein said value of a 
matrix element of said probability matrix which repre- 
sents a most probable estimated value is an integer 
value . 

29. A method as in claim 27 or 28, wherein each mark 
codes a binary value in a first dimension and a binary 
value in a second dimension, and said probability matrix 
is formed by a first probability matrix for the values of 
the marks in said first dimension and a second 
probability matrix for the values of the marks in said 
second dimension. 

30. A computer program which comprises program code 
which, when executed in a computer, causes the computer 
to carry out a method according to any one of claims 1-26 
or claims 27-29. 

31. A computer- readable storage medium on which is 
stored a computer program which, when executed in a com- 
puter, causes the computer to carry out a method accord- 
ing to any one of claims 1-26 or claims 27-29. 

32. An apparatus for position decoding, comprising a 
signal-processing unit which is adapted to extract a 
sequence of positions from a sequence of images of a 
position-coding pattern, as recorded by a sensor, 
characterized in that the signal -processing 
unit is further adapted to: 

retrieve at least one reference position; and 
extract said sequence of positions solely by 
matching information obtained from each of said images 
with a corresponding pattern reference area, which 
represents a known subset of the posit ion- coding pattern 
with a given spatial relation to said reference position. 

33. An apparatus for position decoding, comprising a 
signal -processing unit which is adapted to determine a 
position on the basis of information obtained from a 
partial area, as recorded by a sensor, of a position- 
coding pattern, the position-coding pattern comprising a 
plurality of marks, each mark coding one of at least two 
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different values in at least one dimension, 
characterized in that the signal -processing 
unit is further adapted to: 

generate a probability matrix, said probability 
matrix containing one matrix element for each mark in 
said partial area, each matrix element being adapted to 
store either a value which represents a most probable 
estimated value of its mark, or a value which represents 
that no value has been estimated for its mark; 

match said probability matrix with information about 
how the position-coding pattern is composed in a pattern 
reference area of said position-coding pattern, said 
pattern reference area being larger than said partial 
area and including said partial area; and 

select, as the position to be determined, the one of 
the positions defined by said pattern reference area for 
which the matching step indicates correspondence between 
said probability matrix and said pattern reference area. 



ABSTRACT 



A method, in an apparatus for position decoding, 
operates to extract a sequence of positions from a 
sequence of images of a posit ion- coding pattern, as 
recorded by a sensor. The method, which may be embodied 
as a computer program on a computer -readable storage 
medium, involves the steps of retrieving at least one 
reference position (Pi, Pi'); and extracting the sequence 
of positions solely by matching information obtained from 
each of the images with a corresponding pattern reference 
area (MA) , which represents a known subset of the 
position-coding pattern with a given, direct or indirect, 
spatial relation to the reference position (s) . 
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